Overview of NTCIR-13 ECA Task
نویسندگان
چکیده
This paper presents the overview of NTCIR-13 emotion cause analysis (ECA) task. This task is designed to evaluate the emotion cause analysis techniques which automatically determine whether a clause contain the cause of emotion expression. Unlike the regular evaluation tasks on sentiment analysis or emotion classification, this evaluation task focus on exploring the cause stimulate the emotion. To support this evaluation, the text are manually labelled emotion category and emotion cause to construct an emotion cause corpus which follows the scheme of W3C Emotion Markup Language. We designed two subtasks: The emotion cause detection subtask for identifying the clause containing the emotion cause corresponding to an emotion expression. The emotion cause extraction subtask is designed to evaluate the techniques for detecting the exact boundary of the emotion cause. Eleven teams participated this task and eventually, three valid results for emotion cause detection subtask on Chinese side are submitted. Evaluations shows that the top system achieved 66.5% F-score.
منابع مشابه
Decision Tree Method for the NTCIR-13 ECA Task
This paper details our participation in the Emotion Cause Analysis (ECA), which is a subtask of the NTCIR-13. ECA aims to identify the reasons behind a certain emotion expressed in text. It is a much more difficult task compared with traditional emotion analysis. We consider the task as a slight variation of supervised machine learning classification problems. Inspired by rule-based systems for...
متن کاملWUST CRF-Based System at NTCIR-13 ECA Task
This paper describes our work on Emotion Cause Analysis (ECA) task in NTCIR-13. This task aims to detect the emotion cause description when an emotion happened. In this paper, we apply the Conditional Random Field (CRF) classification model to identifying the emotion cause description with a series of features, such as POS features, basic word features, distance features, and contextual feature...
متن کاملOverview of NTCIR-12
This is an overview of NTCIR-13, the thirteenth sesquiannual research project for evaluating information access technologies. NTCIR-13 presents a diverse set of evaluation tasks related to information retrieval, question answering, natural language processing, etc (in total, nine tasks have been organized at NTCIR-13). This paper describes an outline of the research project, which includes its ...
متن کاملThe GDUFS System in NTCIR-13 ECA Task
Our system participates the evaluation task of emotion cause detection, which is a subtask of emotion cause analysis evaluation in NTCIR-13. The aim of the subtask is to find the clause that contain emotion cause, which is treated as a sequence labeling problem in our system. We employ a structural SVM tool, and build four types of features, including lexical information, distance, contexts and...
متن کاملOverview of the NTCIR-13 OpenLiveQ Task
This is an overview of the NTCIR-13 OpenLiveQ task. This task aims to provide an open live test environment of Yahoo Japan Corporation’s community question-answering service (Yahoo! Chiebukuro) for question retrieval systems. The task was simply defined as follows: given a query and a set of questions with their answers, return a ranked list of questions. Submitted runs were evaluated both offl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017